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ABSTRACT 

In this paper we briefly analyze the various kind of processes which allow one to make a diagnosis.Then 
we focus on one of these processes used for satellite failure diagnosis.This process consists of sending 
instructions to the satellite about system status alterations to make masked the effects of one possible com- 
ponent failure or to look for additional abnormal measures. 

A formal modele of this process is given. This model is an extension of a previously defined connectionist 
model which allows computation of ratios between the likelihoods of observed manifestations according to 
various diagnostic hypothteses.We show that we are able to compute in a similar way the expected mean 
value of these likelihood measures for each possible status of the satellite. Therefore, we are able to select the 
most appropriate status according to three different purposes:to confirm an hypothesis, to eliminate an 
hypothesis, or to choose between two hypotheses. 

Finally a first connectionist schema of computation of these expected mean values is given 
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I Introduction 

There are a lot of human activities which involve diagnostic problem solution. This kind of problem solv- 
ing typically calls to the mind the physician activity looking for the diseases which may be the cause of 
observed symptoms. However similar mental processes are involved when a detective looks for a 
murderer, various specialists try to repair a device and when a scientist tries to dtermine the composition of 
a given sample(proteins by electrophorese for a biologist,chemical composition by spectrum analysis in 
chemistry, etc... 

1.1.1 Various diagnosis procedures 

Everyone who makes a diagnosis does not uses exactly the same reasoning process. How one infers a 
diagnosis depends in part upon their way to get information. We can distinguish at least three main 
classes: 1) All needed information is immediatly available 

2) A part of the needed information is masked from the person trying to make a diagnosis 

3) The cause of the observed symptoms may change during the gathering of information. This 
last case is the most difficult and we will only consider the first two kinds of diagnosis here. 

1.1.2 The most general procedure 

The basic information with which one can deal in a diagnostic process consists of propositions like:a 
given disorder may cause a given symptom or manifestation.Therefore, diagnostic inference cannot only be a 
deductive process:some symptoms of a disorder may be absent and symptoms can be the consequence of 
several disorders. The mathematical modelling of the cause has been the aim of several previously published 
papers:[PEAR86],[PEAR87],[BOUR87],[WALD89].For some of them "may cause” is represented by a 
probability, [PEAR86],[PEAR87], and for others there is a numerical ’’causal strength” between a disorder 
and its manifestations, (PENG87] .In still another model, [BOUR87] the observed manifestations may also be 
caused by unknown disorders and a measure of likelihood of each manifestation is introduced in order to be 
able to neglect the lessprobable manifestations when the deductive process leads to contradictions 

1.1.8 The stepwise procedures 

Inpractice the diagnostic process consists of two alternate phases: 

First seach for a set of plausible hypotheses which explain the set of obseved manifestations, and 
Second, con firm at ion and/or elimination of selected hypotheses. 

I 41 . Mfdc.r to i on in or to e!umi<ale an aypothc^ie one can proceeds in two weys 

a) New queries The simplest approach is to ask new queries the results of which would enable us to confirm 
or to eliminate an hypothesis.But such an approach implies that all needed information is available. This is 
not true in many cases. For instance in a satellite the measured information is chosen when designing the 
satellite and cannot be changed when the satellite is in space. 

b) The indirect diagnosis procedure This second process is applied when a diagnosis is needed for a still 
working device (satellite, in flight aircraft, boats.etc...). This device has many possible working modes. Each 
working mode may mask the effects of some disorders.Therefore by change of working mode (within the 
limits of posible working mode at a given time), people doing diagnosis are able to confirm or to eliminate a 
given hypothesis. For instance, in a satellite failure diagnosis the operator may force the battery to supply 
power to various components in order to eliminate the assumption ’’solar cells failure”, if the manifestations 
diapear with this new working mode. 

1.2 The Satellite Failures Diagnosis Procedure 

The indirect diagnosis procedure has already been studied jBOUR86].It can be summarized as follows. When 
an alarm is on in a satellite control room, con tollers first apply the emergency procedure related to this 
alarm. They, then, try to analyse the latest information which has been sent by the satellite to determine if 
there is a failure and, if so, what kind of failure is it. Because the emegency procedure always protect the 
satellite,sevral hours can be used to make an accurate diagnosis. In the case of low level satellites, it is not 
possible to try several working modes within a revolution because the satellite can only received one com- 
mand and send information back during the short period in which it is visible from antennae. Minimizing 
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the number of needed working modes to complete the diagnosis is thus of prime importance in this case. 
The deduction process is the following:controllers have at their disposal schemas with various levels of 
details. They start from the measured point of the sschema which has caused the alarm and follow the func- 
tional links starting from one component that arrive at this point.Then they make the assumption that 
there is a breakdown in this component. After that they try to eliminate this assumption by looking for 
information, among that most recently received, which contradicts their assumption. If they one they follow 
back the functional links until they identify a new component.This process seems so simple that one might 
think that advanced information systems are not required. But, in fact the process is made more difficult 
by two things. First, in every satellite there are a lot of automatic reconfigurations that occur in order to 
avoid hazardous effects of a failure.Thus the controller has at his/her disposal only a few pieces of informa- 
tion about what has really happened. More often he/she only knows that an automatic reconfiguration has 
happened on a given device. He/she must look through long sequences of measurements in order to detect 
what part of the device has broken. Second, in most cases information is gathered on board the satellite and 
periodically sent to the control center without information on the time at which each has been 
gathered. Only the order in which each piece of information is gathered is known. So it is sometime very 
difficult to exactly know when the failure which caused the alarm happened, and thus which information is 
related to the period before the failure and which one is related to the period after the failure. We can also 
say that the failures are rare on board a satellite, so controllers are not well trained to face this kind of 
event.Morover, failures usually occur more frquently at the end of the satellite life (typically 7 years). By this 
time, the designers of the satellite, who are the most qualify to find the failure, are either no longer available 
or have forgotten a large part of their knowledge about the satellite.Therefore an intelligent decision aid for 
controllers is absolutely needed. 

i 

1.8 The study purposes 

In a previous study [BOUR86], an expert system was prototyped to make diagnosis automatically. But 
the solution had two main drawbacks:it was time consuming (a first list of possible failures needed up to 
tweenty minutes on a SUN/50) and it did not give any advice for selecting a working mode that would be 
the most appropriate to confirm or eliminate an hypothesis on the list. Another previous study has shown 
that making the list of most probable hypothesis can be done using a connectionist- model[PENG89]. We 
have wanted to go further and to compute, in a similar way. which working mode of the satellite would 
give the most information in order to reduce the hypotheses list. 

II General Mathematical Model 

2.1 Notations and basic assumptions 

Let, I) { d l ,...,d n } be the set of possible disorders, 

M={m | } the set of manifestations, 
p i the apriori probabilities of d, , and 

(\l the frequencies with wichrf, causes rrii (c# if there is no causal relation between d i and r/q ) 
Note that c it = P(m / \ d { yFor detailled explanations of this point see[PENG88) 

Let C={cfl } and let e (d i )=(m i :c il ^ 0) Let be Af + the set of observed manifestations in the current 
working mode W 0 and M~—M -AT 4 Let Dj C D be an assumption representing a set of possible disordres 
which can explain all observed manifestations A/ + The following three assumptions are made: 

1) Disorders are independent of each other 

2) Gausa) strength (r l7 ) are invariant : whenever d i occurs it always causes m t with the same strength. 

3) No manifestations can be present without being caused by some disorder. 

Define the Relative Likelihood measure of Dj C D,givenAf 4 , to be L(Df | M + )=P (M + | D/ ) J~] — ^ — 

d. ^D, l ~Pi 

Where P(A/ 4 |/)y) stands for the probabilitybof the observed set of manifestations, given the set of 
disorders Dj . 
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n.2 Main* result® Let a i — (1-c^ 

m,£f (rf t )_A#+ l 1 "?*') 

Let L i{D, ,M + )= El (1- ri (!-««)) [2] 

m,€M + <*, ei>/ 

Then L{D It M+)=Li(DiM+) II I 3 1 

d % eDi 


=L l (D J M 


+ )VB(Dj 


m + ) where UB (Dj t M + )= J| 

d % eD l 


Defition of a ’’confort measure” CM 

CM is a real number btween 0 and 1 which represents how certain we wish to be that a collection of 
diagnosis hypotheses (D Xl D 2l . ..,D k ) includes the actual set of causitives disorders that are present. 

Definition of a minimal solution of a diagnosis problem 

Let D.M,C,A/ + be a diagnosis problem that we wish to solve given a confort measure CM 
( 0<CM < l).S—{D i,D 2 ,.. -,D k }C ’’subsets of D” is said to be a minimal solution the problem iff 

1) P (D t \jD 2 ....\Jd t | M + )= j^PiDi | M + )>CM 

i = 1 
it 

2) for all DjES E P{D t | M*)<CM 

* — l.i/y 

Let A[) } E 

d t €D D } 

Theorem 1 [Peng88] 

For any hypothesis D } C D: E I + )< t/i? (/?/ ,A/ + )( e ^-1) There is an algoritm [PENG88] 

DjOD { 

which allows to determine the k most probable hypothesis among all members of subsets of D and to order 
them by decreasing probabilities. An hypothesis is said to cover a problem if this hypothesis canexplain all 
observed manifestations M + . 


Theorem 2 [Peng88] 

Let D X ,D 2 , ,Dk the k most probale covers of a problem PB™D,M,C.AY + where I) k is the least prob- 
able among the k covers. Let CM be a given confort measure Then S ~{D \,D >,• ) is a solution for prob- 


lem PB if: 

E inf (D l )>CM>Y i *up{D l ) 

i = l »-i 

L U) f \ M') 

where u\[{Df ) 


I m f y 


OjD { 

and sup(L (/)/ ,A/ + ))=-“ 


E L (°J I M + ) UB (D, ,M + )(e A °' 1 ) 
HD, | M 4 ) 


E L(Dj\M + ) 

D j coverof M + 


[5] 


14] 


II.3 A Connectionist Approach of the General Diagnosis Problem Solving [PENG89] 

Let j-, be binary variables. J, =1 if d, ££>/ =0 otherwise. 

Thus to maximize L ( D f \ M + ) amounts to maximize: 

m n n \-x ( \-T) \ 

«(>•)- n c -no- -'»*> » n no-',,*, in i*i 

'=1 m J €W-M +l =l '=1 1 "» X * 

This maximization can be get by the use of a two layers neural network. 
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The units of the first layer represent the manifestations and the units of the second layer represent the 
disorders. 

Xi becomes the activation level of units which represent the disorders. The activation rule of the manifes- 
tation nodes is the following: 

m i (o=i- n 2 »(0) =i - n (i-c.-j *i(0) i 7 i 

* =1 rf, £caugt8 (m, ) 

Thus this activation rule is a local computation since it only depends on current activation levels of ’s 
causative disorders which are directly connected to m ; in the causal network. 

n 

Since x { (0)=p< m ; (0)=1- n Pi ) 

i=l 

The activation rule of x i is a bit more sophisticated. 

Firstly Q(X), which is to maximize is decomposed in Q(X)=Q’(X- 2 : i )<?, (z { (t )). 

Then the activation rule of the node x { is chosen in order to optimize q { (j,- (t )). 

Since (or, (/ )) is only function of x+ (t ), the use of local optimization for each x f - yields to the optimiza- 
tion of Q(X). 

Let A/,- + =A/ + ne (d ( - ) and -M + )C\e (d { ) 

Lei,,(o- n o-no-CH n nd-<**t( 0 )n *~f w 

m t e — 1 *=1 1 x k\ l )Pk 

in which all x k (t) are considered to be parameters and x^t) the only argument of the function 
</;(*.- (0)- 

Note that the first two products in Equation [8] which are local to z, not over M + and A/ -A/' as in Equa- 
tion [6j.In this sense Equation (8] is a patially localized version of Equation [6] (partially because the param- 
eter x k (t ) for k are still present. 


Viewing )) as an objective function and x^t ) as being constraint to {0,1} we decompose the glo- 

bal optimization problem of Dj(t ) into local optimization problems of its elements x i {t) .derive whichever 
of \ or j, (t)“0 will maximize q { , i.e whichever of 7 ,( 1 ) or 7 , (0) is greater, if all other x k (t) are 

fixed. If q i (l)>q i (0) x t (f) should decrease in order to get local optimization.Thus we define the ratio 


n(t)= 


7,U) 


<7i (o) 

r i(o= n ( ■ -* c u 


. It can be proven (PENG89] that: 

1 -*»»(< ) 


Pi 


m, M t + 


m,(l )-c u (t )xi(t ) 


II 

- w 1 Pi 


m, 6 M, 


r t (t ) can rewritten as: 

r i(t ) II (Hq 


l tn, {I ) 


m, <■- M t " 


m, (t )-c u z, (/ ) 


)K, [9| 


The activation rule of the ’’disorders nodes” can easily be deduced from Equation (9| 
Let f(x) be defined as follows: 


= 1 if x > 1 
f(x)— -1 if x < - ] 

™ x otherwise 

dx ( t) 

The activation rule for z ( (/ ) is the following: == / (r t (f )~1)(1-J t - (/ )) 

it 

This differential equation is approximated by the following differences equation: 
Xi{t +A)=z,(J )+/ (r,(* )-l)(l-i, (0)*^ 

But if z,(< + A) is less than 0.0 it is set to 0.0. Thus, as desired z,(/) is guaranteed to be in [0,]] at any 


147 



time t. 

Experimental studies of this model[PENG89] show that it fits well with its purposes and allows to find out 
the most probables hypotheses which may explain the obseved manifetations. 

Ill Modelling The Indirect Procedure 

m.l Notations 

Let i=l,...p be the possible working modes of the satellite 

H( W { )~{dj h dj 2 ,d jk ) the set of ”hiden” disorders in the working mode W { .(the hiden desorders in a 
given working mode are the disorders the effects of which are masked in this working mode. For exampme a 
’’solar cell failure ” is masked in the working mode ” power supplied by battery” 

Let C(rrij ) be the set of disorders which may be the cause of the manifestation rrij 

M*(Wi)=^ U M(dj) be the set of manifestations which can be observed in the working mode 
d^D-H[W x) 


m.2 Various Strategies Models 

We have studied three possible strategies in the choice of the best working mode in an indirect diagnosis 
procedure. First we can want to confirm the most likeky explanation of the first phase diagnosis. In this case 
we have to choose the working mode such that the mean value of this explanation likelihood will be 
maximum. Thus we have to maximize,with respect to W ■ 

E(L(D | W } ))^ £] L(D | Mi 4 )p (A/, + ) where Af t + stands for all possible set of manifestations 


' M.+CA/fVE) 

and p{M i + ) stands for the probability of this set of manifestations to be observed with the working mode 
W ■ .Second we can want to eliminate one of the explanations which has been selected in the first 
phase. For this purpose we have to minimize the mean value of the expected likelihood of this explanation, 
which amount to minimize E (L (D \ Wj)) .Last, the likelihood of the two most likely explanations may be 
very close and we can want to maximize the ratio of their mean values of their expected likelihood. In this 

E{L(D | Wj)) 

case we have to look for IV j which maximizes 


nations of the first phase. 


FAL(iy \w i )) 


if D and D’ are the two most likely expla- 


in. 3 Mathematical Approach 

In order to achieve these objectives we may use the analytical expression of the relative likelihood and 
compute it for each possile set of manifestations and make the wheigthed summation of these results for 
everyworkmg mode. Because such a way becomes quickly untractable when the number of disorders, man- 
ifestations and working mode grows, we will show in the next section how the complexity of the computa- 
tion may be reduced. But before this, we need two easy to compute results :L(D |A/ + -{m/}) and 
L(D | M + U{m/ }) which stand respectively for the relative likelihood of the hypothesis D when the set of 
maifestation is respectively and not m/ and M+ and m t A characteristic of satellite failure diagnosis is 
that we can assume that there is only one failure at a time.Therefore D ~ {d t } According to Equation [2| 
we get: 

^ ma }|m + = n o n (»-<•.;)) 

m } €M + 

LMdi}) im + h n (Mi-*, ■,■))--= n <•., 

m } £ M + m ; £ M 4 

which yelds to: 

Li{{di})\M + Um ,)= FI c *j 

/ m } fA/ + Um; 

M(K})|M + -m,)= n *0- 
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So: 

L (W })|A/ + U»ni )—L i({rf, })c a a,- 

— )}c a * if m, ee (d, )-M + 

Pi (1 C il ) 

=L({d, })c it otherwise [ll] 

L({rf,- })\M + -m t )== — fJ ifm ( GA/ + 

c il 

=L({rf,- })|A/ + ) if m,€e(rf, )-M + 

=L({</,- })|M + )( 1 -c ,7 )— — — otherwise. [12] 

1 -Pi 


Let A(w; ,d { ,M + ,x )—x if m t £e (</,• )-M + 
=1 otherwise 


Let r,-,- 


L(d { 1 M+) 

|A* + 


L (rf, | A^ + Um, ) 

L (<fj | M + \Jm t ' ! 

'Lid; | M + -m,) _ 

L (d } jM + -m,)~ r ' J 


*—* A(m, ,d { ,M + 

c ji 

t if m t €M + 

<\v 


1 -P, 


)* A(rn, ,<fy ,A/ + , 


= r,y if m, G e ( d, )fie ( dy )--M 4 

=r,j (l-c.7 )~- 'f m i €e (d, )-e (dy , 

~ r ij (f ' c ;( )~T^~ if m l et(dj)-c(d i] [H| 

1 -P; 


P;(f- C jv) 

1 -P; 


[13] 


We also need the a priori probability of a given set of manifestations M s in a given working mode W % 

p(M, i w i )= n p ( m j ) n (i-pK)) [is] 


m J €M s m.fM'IH', )-M, 


p (nij )=Nj £ Pi 

rf, c// ( W, ) 

Nj is a constant such that 


(remember that c i; ~0 if nij )) 

E P(K I 

M s h.M 0 ( W t ) 


From [15] we easily get: 

P(M 

P(M,Um t | 


Wi)p(mt) 


P{M.-mt | Wi )- 


1 -p(m,) 

P{M, | Wj )( 1 — p (m t ) 


p( m i) 


|16| 

[17] 


We are now able to compute: 

E(L (d ,) | M , 4 | W { )= L(d , | M» )P (M g | It', ) by computing L (d , | M t ) from /, (d , | M, + ) 

by suecesives use of formulae [2] and [3] 

But we have to compute 2 ^ ^ +1 values and we are going to show in the next section that formulae 

[1 1], [12], [13], [14], [16], [17] allow us to minimize the cost of the computation of one value. In the last section 
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we give a theoretical neural ntework which enables us to get the expected mean value of E (L (d x ) \ Wj ) 
and therefore its maximum or minimum among the avilable fK, 


III. 4 Complexity analysis and computational cost minimization 

If we want to compute L (d, | M , ) we need 1 + I «K) I + | M 8 | operations and P (M 9 
I | operations. 

Thus the computation of one of the term of E{L{d l \ W i )) needs 2 | M 8 ) -b 

| | 

operations. Because the mean value of | M g i is the total computation cost of E [L [d x 


W - ) needs 

e {d 1 ) | +1 
Wi)) 

z 

is (1-h | e (d i | + | M * ( Wi ) | )2 ^ But,using formulae [1 1], [12], [13], [14], [16], [17] the computation 

cost of P(A/, | W±) is only three operations, the computation of L (d { \ M g ) is only one operation and the 

total cost of computation is reduced to 3* 2 ' M ) i +1 

I A 4 * (W ) I 

In order to only use this set of formulae we have to use an algorithm which generates the 2 1 parts 

of M*(Wi) in an order such that we can transform each part in the following part only by adding or 
suppressing an element. This can easily be done by the following recursive algoritm.Let us assume that we 
want to generate the 2 N parts of a set of N elements {a Xl a 2 >. ..,a N } with respect to the property that two 
successives parts only differ by one element. Let us assume that we have genrate the 2^~ l p&rts of the subset 
{a a 2 >** J a N-\} w ilh respect to the previous property on the order of the parts. Let us assume that the 
empty set is the first part and that the last part consists of a single element. Let us also assume that the 
first non empty part is also a single element.Therefore we have 2^ 1 1 non empty parts. In order to get the 
2 /V parts with respect to the four previously assumed properties we only need to repeat in the reverse order 
the 2 yV-1 -l non empty pars with adding the N th element ; in such a way we get *2 /v “ 1 -l parts with a n 
begining and ending by a two elements part ;{a t ,a N } and {u ; - ,a N } .This last element can give the part 
{a N } by suppressing a ; * 

By concatenation of the two lists of 2 Nl ~l parts and {fl/v} we get 2^-1 parts. Therefore with the empty 
set we have 2 N parts and these parts are ordered with respect to the four previously enouced properties. 


Example 


y { a \, a 3, a 4 ^ 


m- 

► {a l 7 a 2 l a^a 4 } 


*{ a 2' a 3> a 4 } ^ { a 2> a 4 }“ 


I { w 2> ^ 3 } * { 1 > ^ 2 > 3 } * { a 1 ? 3 } * { a 3 } I 

4 }— 4 }] 


I M * { IV 'l 

Remark The ^ v pccted mean value of the likelihood needs a maximum of computation 2 ‘ ' 1 terms 

because those related to £M * ( W', )p|M +l are already known. The exact number of terms whic have to 
be computed is 2 1 and the strarting value is in this case L(d, | M -M ( )) 


IV Towards a full connectionist solution 

It is obvious that for large | M * ( W i ) | the proposed solution in the previous section becomes 
intractable. Because the maximum of L (d { | A// ) can be found by the means of a connectionnist network 
the way of a full connectionist solution must be taken into account.The exact computation of a mean value 

only seems to be done by an Hopfield model network in which each unit represents a part of 

M* {Wj)~M i + and is linked to the two parts which differ by only one element as it is shown in the previ- 
ous section. The weight of the link is the factor by which the activity level of a unit must be multiplied in 
order to get the activity level of the following. But.since this introduces an order for the computation of 
units activity levels, there is no parallelism in the method .Moreover ,because such a machine with a large 
number of units is not available nowadays we have not search an algorithm which allows us the use of 

parllelism,but it must be noticed that the optimum computation cost should be | M* (W { ) \ - \ M j + | 

cycles (one for all parts of size 1, one for all parts of size 2 and so on). 

Another way is to use a competitive activation model in which the units which compete represent a work- 
ing mode which is associated with a given disorder the likelihood of which has the required property (i.e to 


150 



be maximum, or to be the seconder to be minimum in a given set).By similar activation rules (even for 
minimization for which only the ratio r, (£ ) is changed in ) we can determine which working mode 

has the maximium likelihood with respect to the set of manifestations units.These manifestations units 
have an activation level equal to the mean value of the binary random variable related to the presence of 
the manifestation.(See Figure 1) 

In this case , which can easily be implemented on an actual machine with a few thousands of units,we do 
not compute the expected mean value of the likelihood but the likelihood of the mean values of the man- 
ifestations which can be observed during a given working mode.This is different of our initial purpose but 
can be a good criterion for the selection of the working mode 

We have seen that with a very sligthly modification we can define a network which determines the work- 
ing mode which has the smallest likelihood of the manifestations mean values for a given disorder. Therefore 
we can help a controller for the choice of the best working mode which would enable him to confirm 

) an explanation. But for the working mode which should maximize 

i.e for which the two explanations d, and dj should have likelihoods the most 

different) we must define another net work. (See Figure 2) This network consists of the both networks previ- 
ously defined and a set of units which represent each possible working mode. Their activation levels are the 
ratio between the activation level of the working mode related to an explanation and the activation level of 
the same working mode related to the other explanation.The unit with the maximum activity level showes 
the best wor king mode for the choice between the two explanations. 


(respectively eliminate 

Lid, lA/*(^)-AV) 
L{d: \M*{W k )-M , + ) 


V Conclusion 

The framework of a method which allows one to minimizes the number of successives working modes 
which can be needed for an accurate diagnosis of a satellite failure is established. This method will become 
tractable when large enough actual neural network become available. Like it can be seen in the previous sec- 
tions some problems are not yet entirely solved and can only be solved when the characteristics of specific 
networks will be known. But we also want to outline that this method can be used in a lot of others area;for 
instance the set size of biological experiments which are needed to type the histocompatibility of cells can 
be significantly reduced by a stepwise building of experiments plan which is based on the presented 
method. 
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Manifestation 



uf k dj competes for minimum w k ( U competes for maximum 

Figure 2 
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